Electronic device and method for capturing image by using display

ABSTRACT

An electronic device for capturing an image by using a display is provided. The electronic device includes a display, a display controller configured to operate the display using a first lighting parameter and a second lighting parameter to generate an afterimage effect for objects included in images, a camera configured to capture an image to be displayed by the display, and a processor configured to determine a camera operation parameter corresponding to a final lighting parameter of the display for a capture operation of the camera. Therefore the electronic device according to various embodiments of the present disclosure can capture a high quality image in a dark environment.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit under 35 U.S.C. § 119(a) of a Koreanpatent application filed on Feb. 19, 2016 in the Korean IntellectualProperty Office and assigned Serial number 10-2016-0019472, the entiredisclosure of which is hereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates to an electronic device and a method forcapturing an image by using a display. More particularly, the presentdisclosure relates to a technology for photographing an object by usingan illumination of a display itself.

BACKGROUND

Various electronic devices such as a smartphone, tablet personalcomputer (PC), portable multimedia player (PMP), personal digitalassistant (PDA), laptop PC, and wearable device can provide variousfunctions such as a social networking service (SNS), Internet,multimedia, photo/video capture and play, and documentation task as wellas a telephone function.

In particular, the culture of photographing a user's own face by using afront camera installed in an electronic device is growing rapidly.However, there are difficulties in capturing an image with the frontcamera in a dark place because the front camera is not equipped with alighting device.

In order to overcome these difficulties, photographing technologies ofusing a light source of a display are being developed in the field ofphotographing an image by using a front camera.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Technologies of capturing an image by using a light source of a displaydetect information about the adjacent environment and control thebrightness of the display according to the detected environmentalinformation according to the related art. It is possible to control thebrightness by adjusting an electric current supplied to the display andto use a white screen as a lighting according to the related art. Alighting condition of the display must be re-adjusted to obtain anoptimum lighting condition by using a white screen, and camera operationparameters are generally used before using the lighting. In thissituation, if a user intends to photograph by using a front camera in adark space, problems may be generated because focusing is performedunnaturally and incorrectly.

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect of the presentdisclosure is to provide an electronic device and a method for capturingan image naturally in a dark space.

In accordance with an aspect of the present disclosure, an electronicdevice is provided. The electronic device includes a display, a displaycontroller configured to operate the display using a first lightingparameter and a second parameter to generate an afterimage effect forobjects included in images, a camera configured to capture an image tobe displayed by the display, and a processor configured to determine acamera operation parameter corresponding to a final lighting parameterof the display for a capture operation of the camera.

In accordance with another aspect of the present disclosure, a method isprovided. The method for capturing an image by using a display of anelectronic device includes controlling the display to operate using afirst lighting parameter and a second lighting parameter to generate anafterimage effect for an object included in the image, capturing animage to be displayed by the display, and determining a camera operationparameter corresponding to a final lighting parameter of the display fora capture operation of the camera.

The electronic device and the method for capturing an image by using adisplay according to various embodiments of the present disclosureenables a user to compose and adjust an image easily by changing alighting output by a display gradually and displaying an afterimage ofan object type for the user.

The electronic device and the method for capturing an image by using adisplay according to various embodiments of the present disclosure canextract optimum camera operation parameters by capturing an image withan obtained camera operation parameter and obtaining a new cameraoperation parameter from the captured image.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 illustrates an electronic device in a network environmentaccording to various embodiments of the present disclosure;

FIG. 2 is a block diagram illustrating a configuration of an electronicdevice according to various embodiments of the present disclosure;

FIG. 3 is a block diagram illustrating a configuration of a programmodule according to various embodiments of the present disclosure;

FIG. 4 is a block diagram illustrating a configuration of an electronicdevice according to various embodiments of the present disclosure;

FIG. 5 illustrates images captured while controlling to graduallyincrease the brightness of a display according to various embodiments ofthe present disclosure;

FIG. 6A illustrates a method for adjusting a display based on a firstlighting parameter to a third lighting parameter according to variousembodiments of the present disclosure;

FIG. 6B illustrates an example of photographing an object by using adisplay of an electronic device which performs an image captureaccording to an embodiment of the present disclosure;

FIG. 7 is a graph illustrating changes of an image brightness and anelectric current amount supplied to a display according to an embodimentof the present disclosure;

FIGS. 8, 9, and 10 are graphs illustrating various examples ofincreasing brightness of a display according to various embodiments ofthe present disclosure;

FIGS. 11 and 12 are graphs illustrating examples of obtaining cameraoperation parameters for each frame according to various embodiments ofthe present disclosure;

FIG. 13 is a flowchart illustrating a method for capturing an image byusing a display according to an embodiment of the present disclosure;

FIG. 14 is a flowchart illustrating a method for capturing an image byusing a display according to an embodiment of the present disclosure;and

FIG. 15 is a flowchart illustrating a method for capturing an image byusing a display according to an embodiment of the present disclosure.

Throughout the drawings, it should be noted that like reference numbersare used to depict the same or similar elements, features, andstructures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

By the term “substantially” it is meant that the recited characteristic,parameter, or value need not be achieved exactly, but that deviations orvariations, including for example, tolerances, measurement error,measurement accuracy limitations and other factors known to those ofskill in the art, may occur in amounts that do not preclude the effectthe characteristic was intended to provide.

The expressions, such as “include” and “may include” which may be usedin the present disclosure denote the presence of the disclosedfunctions, operations, and constituent elements and do not limit one ormore additional functions, operations, and constituent elements. In anembodiment of the present disclosure, the terms, such as “include”and/or “have” may be construed to denote a certain characteristic,number, operation, constituent element, component or a combinationthereof, but may not be construed to exclude the existence of or apossibility of addition of one or more other characteristics, numbers,operations, constituent elements, components or combinations thereof.

Furthermore, in the present disclosure, the expression “and/or” includesany and all combinations of the associated listed words. For example,the expression “A and/or B” may include A, may include B, or may includeboth A and B.

In an embodiment of the present disclosure, expressions includingordinal numbers, such as “first” and “second,” and the like, may modifyvarious elements. However, such elements are not limited by the aboveexpressions. For example, the above expressions do not limit thesequence and/or importance of the elements. The above expressions areused merely for the purpose to distinguish an element from the otherelements. For example, a first user device and a second user deviceindicate different user devices although both of them are user devices.For example, a first element could be termed a second element, andsimilarly, a second element could be also termed a first element withoutdeparting from the scope of the present disclosure.

In the case where a component is referred to as being “connected” or“accessed” to other component, it should be understood that not only thecomponent is directly connected or accessed to the other component, butalso there may exist another component between them. Meanwhile, in thecase where a component is referred to as being “directly connected” or“directly accessed” to other component, it should be understood thatthere is no component therebetween. The terms used in the presentdisclosure are only used to describe specific various embodiments of thepresent disclosure, and are not intended to limit the presentdisclosure. As used herein, the singular forms are intended to includethe plural forms as well, unless the context clearly indicatesotherwise. Singular forms are intended to include plural forms unlessthe context clearly indicates otherwise.

An electronic device according to the present disclosure may be a deviceincluding a communication function. For example, the device correspondsto a combination of at least one of a smartphone, a tablet personalcomputer (PC), a mobile phone, a video phone, an e-book reader, adesktop PC, a laptop PC, a netbook computer, a personal digitalassistant (PDA), a portable multimedia player (PMP), a digital audioplayer, a mobile medical device, an electronic bracelet, an electronicnecklace, an electronic accessory, a camera, a wearable device, anelectronic clock, a wrist watch, home appliances (for example, anair-conditioner, vacuum, an oven, a microwave, a washing machine, an aircleaner, and the like), an artificial intelligence robot, a television(TV), a digital versatile disc (DVD) player, an audio device, variousmedical devices (for example, magnetic resonance angiography (MRA),magnetic resonance imaging (MRI), computed tomography (CT), a scanningmachine, an ultrasonic wave device, and the like), a navigation device,a global positioning system (GPS) receiver, an event data recorder(EDR), a flight data recorder (FDR), a set-top box, a TV box (forexample, Samsung HomeSync™, Apple TV™, or Google TV™), an electronicdictionary, vehicle infotainment device, an electronic equipment for aship (for example, navigation equipment for a ship, gyrocompass, and thelike), avionics, a security device, electronic clothes, an electronickey, a camcorder, game consoles, a head-mounted display (HMD), a flatpanel display device, an electronic frame, an electronic album,furniture or a portion of a building/structure that includes acommunication function, an electronic board, an electronic signaturereceiving device, a projector, and the like. It is obvious to thoseskilled in the art that the electronic device according to the presentdisclosure is not limited to the aforementioned devices.

FIG. 1 is a block diagram illustrating a configuration of an electronicdevice according to an embodiment of the present disclosure.

Referring to FIG. 1, an electronic device 100 may include a bus 110, aprocessor 120, a memory 130, an input/output (I/O) module 150, a displaymodule 160, a communication module 170, and other similar and/orsuitable components.

The bus 110 may be a circuit which interconnects the above-describedelements and delivers a communication (e.g., a control message) betweenthe above-described elements.

The processor 120 may receive commands from the above-described otherelements (e.g., the memory 130, the I/O module 150, the display module160, the communication module 170, and the like) through the bus 110,may interpret the received commands, and may execute calculation or dataprocessing according to the interpreted commands.

The memory 130 may store commands or data received from the processor120 or other elements (e.g., the I/O module 150, the display module 160,the communication module 170, and the like) or generated by theprocessor 120 or the other elements. The memory 130 may includeprogramming modules, such as a kernel 141, middleware 143, anapplication programming interface (API) 145, an application 147, and thelike. Each of the above-described programming modules may be implementedin software, firmware, hardware, or a combination of two or morethereof.

The kernel 141 may control or manage system resources (e.g., the bus110, the processor 120, the memory 130, and the like) used to executeoperations or functions implemented by other programming modules (e.g.,the middleware 143, the API 145, and the application 147). In addition,the kernel 141 may provide an interface capable of accessing andcontrolling or managing the individual elements of the electronic device100 by using the middleware 143, the API 145, or the application 147.

The middleware 143 may serve to go between the API 145 or theapplication 147 and the kernel 141 in such a manner that the API 145 orthe application 147 communicates with the kernel 141 and exchanges datatherewith. In addition, in relation to work requests received from oneor more applications 140 and/or the middleware 143, for example, themiddleware 143 may perform load balancing of the work requests by usinga method of assigning a priority, in which system resources (e.g., thebus 110, the processor 120, the memory 130, and the like) of theelectronic device 100 are allocated, to at least one of the one or moreapplications 140.

The API 145 is an interface through which the application 147 is capableof controlling a function provided by the kernel 141 or the middleware143, and may include, for example, at least one interface or functionfor file control, window control, image processing, character control,and the like.

The I/O module 150, for example, may receive a command or data as inputfrom a user, and may deliver the received command or data to theprocessor 120 or the memory 130 through the bus 110. The display module160 may display a video, an image, data, and the like, to the user.

The communication module 170 may connect communication between anotherelectronic device 102 and the electronic device 100. The communicationmodule 170 may support a short-range communication protocol 164 (e.g.,Wi-Fi, Bluetooth (BT), and near field communication (NFC)), or a network162 (e.g., the Internet, a local area network (LAN), a wide area network(WAN), a telecommunication network, a cellular network, a satellitenetwork, a plain old telephone service (POTS), and the like). Each ofthe electronic devices 102 and 104 may be identical (e.g., of anidentical type) to or different (e.g., of a different type) from theelectronic device 100. Further, the communication module 170 may connectcommunication between a server 106 and the electronic device 100 via thenetwork 162.

FIG. 2 is a block diagram illustrating a configuration of an electronicdevice according to an embodiment of the present disclosure.

Referring to FIG. 2, an electronic device 201 may be, for example, theelectronic device 100 illustrated in FIG. 1.

The electronic device 201 may include one or more processors 210, asubscriber identification module (SIM) card 224, a memory 230, acommunication module 220, a sensor module 240, a user input module 250,a display module 260, an interface 270, an audio module 280, a cameramodule 291, a power management module 295, a battery 296, an indicator297, a motor 298 and any other similar and/or suitable components.

The processor 210 (e.g., the processor 120) may include one or moreapplication processors (APs), or one or more communication processors(CPs). The processor 210 may be, for example, the processor 120illustrated in FIG. 1. The AP and the CP are illustrated as beingincluded in the processor 210 in FIG. 2, but may be included indifferent integrated circuit (IC) packages, respectively. According toan embodiment of the present disclosure, the AP and the CP may beincluded in one IC package.

The AP may execute an operating system (OS) or an application program,and thereby may control multiple hardware or software elements connectedto the AP and may perform processing of and arithmetic operations onvarious data including multimedia data. The AP may be implemented by,for example, a system on chip (SoC). According to an embodiment of thepresent disclosure, the processor 210 may further include a graphicsprocessing unit (GPU) (not illustrated).

The CP may manage a data line and may convert a communication protocolin the case of communication between the electronic device (e.g., theelectronic device 100) including the electronic device 201 and differentelectronic devices connected to the electronic device through thenetwork. The CP may be implemented by, for example, an SoC. According toan embodiment of the present disclosure, the CP may perform at leastsome of multimedia control functions. The CP, for example, maydistinguish and authenticate a terminal in a communication network byusing a SIM (e.g., the SIM card 224). In addition, the CP may providethe user with services, such as a voice telephony call, a videotelephony call, a text message, packet data, and the like.

Further, the CP may control the transmission and reception of data bythe communication module 220. In FIG. 2, the elements, such as the CP,the power management module 295, the memory 230, and the like areillustrated as elements separate from the AP. However, according to anembodiment of the present disclosure, the AP may include at least some(e.g., the CP) of the above-described elements.

According to an embodiment of the present disclosure, the AP or the CPmay load, to a volatile memory, a command or data received from at leastone of a non-volatile memory and other elements connected to each of theAP and the CP, and may process the loaded command or data. In addition,the AP or the CP may store, in a non-volatile memory, data received fromor generated by at least one of the other elements.

The SIM card 224 may be inserted into a slot formed in a particularportion of the electronic device 100. The SIM card 224 may includeunique identification information (e.g., integrated circuit cardidentifier (ICCID)) or subscriber information (e.g., internationalmobile subscriber identity (IMSI)).

The memory 230 may include an internal memory 232 and an external memory234. The memory 230 may be, for example, the memory 130 illustrated inFIG. 1. The internal memory 232 may include, for example, at least oneof a volatile memory (e.g., a random access memory (RAM), a dynamic RAM(DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM), and thelike), and a non-volatile memory (e.g., a read only memory (ROM), a onetime programmable ROM (OTPROM), a programmable ROM (PROM), an erasableand programmable ROM (EPROM), an electrically erasable and programmableROM (EEPROM), a mask ROM, a flash ROM, a not AND (NAND) flash memory, anot OR (NOR) flash memory, and the like). According to an embodiment ofthe present disclosure, the internal memory 232 may be in the form of asolid state drive (SSD). The external memory 234 may further include aflash drive, for example, a compact flash (CF), a secure digital (SD), amicro-SD, a mini-SD, an extreme digital (xD), a memory stick, and thelike.

The communication module 220 may include a communication module 220including a radio frequency (RF) module 229. The communication module220 may be, for example, the communication module 160 illustrated inFIG. 1. The communication module 220 may include, for example, a Wi-Fimodule 223, a BT module 225, a GPS module 227, and a NFC module 228. Forexample, the communication module 220 may provide a wirelesscommunication function by using an RF. Additionally or alternatively,the communication module 220 may include a network interface (e.g., aLAN card), a modulator/demodulator (modem), and the like for connectingthe electronic device 201 to a network (e.g., the Internet, a LAN, aWAN, a telecommunication network, a cellular network, a satellitenetwork, a POTS, and the like).

The communication module 220 (e.g., the communication module 170) mayperform data communication with other electronic devices (e.g., theelectronic device 104 and the server 106) through a network. Accordingto an embodiment of the present disclosure, the communication module 220may include a cellular module 221, a Wi-Fi module 223, a BT module 225,a GPS module 227, an NFC module 228, and an RF module 229.

The RF module 229 may be used for transmission and reception of data,for example, transmission and reception of RF signals or otherelectronic signals. Although not illustrated, the RF module 229 mayinclude, for example, a transceiver, a power amplifier module (PAM), afrequency filter, a low noise amplifier (LNA), and the like. Inaddition, the RF module 229 may further include a component fortransmitting and receiving electromagnetic waves in a free space in awireless communication, for example, a conductor, a conductive wire, andthe like.

The sensor module 240 may include, for example, at least one of agesture sensor 240A, a gyro sensor 240B, an atmospheric pressure sensor240C, a magnetic sensor 240D, an acceleration sensor 240E, a grip sensor240F, a proximity sensor 240G, a red, green and blue (RGB) sensor 240H,a biometric sensor 240I, a temperature/humidity sensor 240J, anilluminance sensor 240K, and an ultra violet (UV) sensor 240M. Thesensor module 240 may measure a physical quantity or may detect anoperating state of the electronic device 201, and may convert themeasured or detected information to an electrical signal.Additionally/alternatively, the sensor module 240 may include, forexample, an Electronic nose (E-nose) sensor (not illustrated), anelectromyography (EMG) sensor (not illustrated), an electroencephalogram(EEG) sensor (not illustrated), an electrocardiogram (ECG) sensor (notillustrated), a fingerprint sensor (not illustrated), and the like. Thesensor module 240 may further include a control circuit (notillustrated) for controlling one or more sensors included therein.

The user input module 250 may include a touch panel 252, a pen sensor254 (e.g., a digital pen sensor), keys 256, and an ultrasonic inputdevice 258. The user input module 250 may be, for example, the I/Omodule 150 illustrated in FIG. 1. The touch panel 252 may recognize atouch input in at least one of, for example, a capacitive scheme, aresistive scheme, an infrared scheme, and an acoustic wave scheme. Inaddition, the touch panel 252 may further include a controller (notillustrated). In the capacitive type, the touch panel 252 is capable ofrecognizing proximity as well as a direct touch. The touch panel 252 mayfurther include a tactile layer (not illustrated). In this event, thetouch panel 252 may provide a tactile response to the user.

The pen sensor 254 (e.g., a digital pen sensor), for example, may beimplemented by using a method identical or similar to a method ofreceiving a touch input from the user, or by using a separate sheet forrecognition. For example, a key pad or a touch key may be used as thekeys 256. The ultrasonic input device 258 enables the terminal to detecta sound wave by using a microphone (e.g., a microphone 288) of theterminal through a pen generating an ultrasonic signal, and to identifydata. The ultrasonic input device 258 is capable of wirelessrecognition. According to an embodiment of the present disclosure, theelectronic device 201 may receive a user input from an external device(e.g., a network, a computer, or a server), which is connected to thecommunication module 220, through the communication module 220.

The display module 260 may include a panel 262, a hologram 264, and aprojector 266. The display module 260 may be, for example, the displaymodule 160 illustrated in FIG. 1. The panel 262 may be, for example, aliquid crystal display (LCD) and an active matrix organic light emittingdiode (AM-OLED) display, and the like. The panel 262 may be implementedso as to be, for example, flexible, transparent, or wearable. The panel262 may include the touch panel 252. The hologram 264 may display athree-dimensional image in the air by using interference of light. Theprojector 266 is configured to project images onto a surface. Accordingto an embodiment of the present disclosure, the display module 260 mayfurther include a control circuit for controlling the panel 262, thehologram 264, and the projectors 266.

The interface 270 may include various connection such as, for example, ahigh-definition multimedia interface (HDMI) 272, a universal serial bus(USB) 274, an optical interface 276, and a d-subminiature (D-sub) 278.Additionally or alternatively, the interface 270 may include, forexample, SD/multi-media card (MMC) (not illustrated) or infrared dataassociation (IrDA) (not illustrated).

An audio module 280 may bidirectionally convert between a voice and anelectrical signal. The audio module 280 may convert voice information,which is input to or output from the audio module 280, through, forexample, a speaker 282, a receiver 284, an earphone 286, the microphone288, and the like.

The camera module 291 may capture an image and a moving image. Accordingto an embodiment of the present disclosure, the camera module 291 mayinclude one or more image sensors (e.g., a front lens or a back lens),an image signal processor (ISP) (not illustrated), and a flash LED (notillustrated).

The power management module 295 may manage power of the electronicdevice 201. Although not illustrated, the power management module 295may include, for example, a power management IC (PMIC), a charger IC, ora battery fuel gauge.

The PMIC may be mounted to, for example, an IC or an SoC semiconductor.Charging methods may be classified into a wired charging method and awireless charging method. The charger IC may charge a battery, and mayprevent an overvoltage or an overcurrent from a charger to the battery.According to an embodiment of the present disclosure, the charger IC mayinclude a charger IC for at least one of the wired charging method andthe wireless charging method. Examples of the wireless charging methodmay include a magnetic resonance method, a magnetic induction method, anelectromagnetic method, and the like. Additional circuits (e.g., a coilloop, a resonance circuit, a rectifier, and the like) for wirelesscharging may be added to perform the wireless charging.

The battery fuel gauge may measure, for example, a residual quantity ofthe battery 296, or a voltage, a current, and a temperature during thecharging. The battery 296 may supply power by generating electricity,and may be, for example, a rechargeable battery.

The indicator 297 may indicate particular states of the electronicdevice 201 or a part (e.g., the AP) of the electronic device 201, forexample, a booting state, a message state, a charging state and thelike. The motor 298 may convert an electrical signal into a mechanicalvibration. The processor 210 may control the sensor module 240.

Although not illustrated, the electronic device 201 may include aprocessing unit (e.g., a GPU) for supporting a mobile TV. The processingunit for supporting a mobile TV may process media data according tostandards, such as, for example, digital multimedia broadcasting (DMB),digital video broadcasting (DVB), media flow, and the like. Each of theabove-described elements of the electronic device 201 according to anembodiment of the present disclosure may include one or more components,and the name of the relevant element may change depending on the type ofelectronic device. The electronic device 201 according to an embodimentof the present disclosure may include at least one of theabove-described elements. Some of the above-described elements may beomitted from the electronic device 201, or the electronic device 201 mayfurther include additional elements. In addition, some of the elementsof the electronic device 201 according to an embodiment of the presentdisclosure may be combined into one entity, which may perform functionsidentical to those of the relevant elements before the combination.

The term “module” used in the present disclosure may refer to, forexample, a unit including one or more combinations of hardware,software, and firmware. The “module” may be interchangeable with a term,such as “unit,” “logic,” “logical block,” “component,” “circuit,” andthe like. The “module” may be a minimum unit of a component formed asone body or a part thereof. The “module” may be a minimum unit forperforming one or more functions or a part thereof. The “module” may beimplemented mechanically or electronically. For example, the “module”according to an embodiment of the present disclosure may include atleast one of an application-specific integrated circuit (ASIC) chip, afield-programmable gate array (FPGA), and a programmable-logic devicefor performing certain operations which have been known or are to bedeveloped in the future.

FIG. 3 is a block diagram illustrating a configuration of a programmingmodule according to an embodiment of the present disclosure.

Referring to FIG. 3, a programming module 310 may be included (orstored) in the electronic device 100 (e.g., the memory 130) or may beincluded (or stored) in the electronic device 201 (e.g., the memory230). At least a part of the programming module 310 may be implementedin software, firmware, hardware, or a combination of two or morethereof. The programming module 310 may be implemented in hardware(e.g., the electronic device 201), and may include an OS for controllingresources related to an electronic device and/or various applications(e.g., an application 370) that are executed in the OS. For example, theOS may be Android®, iOS®, Windows®, Symbian®, Tizen®, Bala®, and thelike.

Referring to FIG. 3, the programming module 310 may include a kernel320, a middleware 330, an API 360, and/or one or more applications 370.

The kernel 320 (e.g., the kernel 141) may include a system resourcemanager 321 and/or a device driver 322. The system resource manager 321may include, for example, a process manager (not illustrated), a memorymanager (not illustrated), and a file system manager (not illustrated).The system resource manager 321 may perform the control, allocation,recovery, and the like of system resources. The device driver 322 mayinclude, for example, a display driver (not illustrated), a cameradriver (not illustrated), a BT driver (not illustrated), a shared memorydriver (not illustrated), a USB driver (not illustrated), a keypaddriver (not illustrated), a Wi-Fi driver (not illustrated), and/or anaudio driver (not illustrated). In addition, according to an embodimentof the present disclosure, the device driver 312 may include aninter-process communication (IPC) driver (not illustrated).

The middleware 330 may include multiple modules previously implementedto provide a function used in common by the applications 370. Inaddition, the middleware 330 may provide a function to the applications370 through the API 360 to enable the applications 370 to efficientlyuse limited system resources within the electronic device. For example,as illustrated in FIG. 3, the middleware 330 (e.g., the middleware 143)may include at least one of a runtime library 335, an applicationmanager 341, a window manager 342, a multimedia manager 343, a resourcemanager 344, a power manager 345, a database manager 346, a packagemanager 347, a connection manager 348, a notification manager 349, alocation manager 350, a graphic manager 351, a security manager 352, andany other suitable and/or similar manager.

The runtime library 335 may include, for example, a library module usedby a complier, to add a new function by using a programming languageduring the execution of the application 370. According to an embodimentof the present disclosure, the runtime library 335 may perform functionswhich are related to input and output, the management of a memory, anarithmetic function, and the like.

The application manager 341 may manage, for example, a life cycle of atleast one of the applications 370. The window manager 342 may managegraphical user interface (GUI) resources used on the screen. Themultimedia manager 343 may detect a format used to reproduce variousmedia files and may encode or decode a media file through acoder/decoder (codec) appropriate for the relevant format. The resourcemanager 344 may manage resources, such as a source code, a memory, astorage space, and the like of at least one of the applications 370.

The power manager 345 may operate together with a basic input/outputsystem (BIOS), may manage a battery or power, and may provide powerinformation and the like used for an operation. The database manager 346may manage a database to enable the generation, search and/or change ofthe database to be used by at least one of the applications 370. Thepackage manager 347 may manage the installation and/or update of anapplication distributed in the form of a package file.

The connection manager 348 may manage a wireless connection, such as,for example, a Wi-Fi connection and a BT connection. The notificationmanager 349 may display or report, to the user, an event, such as anarrival message, an appointment, a proximity alarm, and the like in sucha manner as not to disturb the user. The location manager 350 may managelocation information of the electronic device. The graphic manager 351may manage a graphical effect, which is to be provided to the user,and/or a user interface related to the graphical effect. The securitymanager 352 may provide various security functions used for systemsecurity, user authentication, and the like. According to an embodimentof the present disclosure, when the electronic device (e.g., theelectronic device 100) includes a telephone function, the middleware 330may further include a telephony manager (not illustrated) for managing avoice telephony call function and/or a video telephony call function ofthe electronic device.

The middleware 330 may generate and use a new middleware module throughvarious functional combinations of the above-described internal elementmodules. The middleware 330 may provide modules specialized according totypes of OSs to provide differentiated functions. In addition, themiddleware 330 may dynamically delete some of the existing elements, ormay add new elements. Accordingly, the middleware 330 may omit some ofthe elements described in the various embodiments of the presentdisclosure, may further include other elements, or may replace some ofthe elements with other elements, each of which performs a similarfunction and has a different name.

The API 360 (e.g., the API 145) is a set of API programming functions,and may be provided with a different configuration according to an OS.In the case of Android® or iOS®, for example, one API set may beprovided to each platform. In the case of Tizen®, for example, two ormore API sets may be provided.

The applications 370 (e.g., the applications 147) may include, forexample, a preloaded application and/or a third party application. Theapplications 370 (e.g., the applications 147) may include, for example,a home application 371, a dialer application 372, a short messageservice (SMS)/multimedia message service (MMS) application 373, aninstant message (IM) application 374, a browser application 375, acamera application 376, an alarm application 377, a contact application378, a voice dial application 379, an electronic mail (e-mail)application 380, a calendar application 381, a media player application382, an album application 383, a clock application 384, and any othersuitable and/or similar application.

At least a part of the programming module 310 may be implemented byinstructions stored in a non-transitory computer-readable storagemedium. When the instructions are executed by one or more processors(e.g., the one or more processors 210), the one or more processors mayperform functions corresponding to the instructions. The non-transitorycomputer-readable storage medium may be, for example, the memory 230. Atleast a part of the programming module 310 may be implemented (e.g.,executed) by, for example, the one or more processors 210. At least apart of the programming module 310 may include, for example, a module, aprogram, a routine, a set of instructions, and/or a process forperforming one or more functions.

Names of the elements of the programming module (e.g., the programmingmodule 310) according to an embodiment of the present disclosure maychange depending on the type of OS. The programming module according toan embodiment of the present disclosure may include one or more of theabove-described elements. Alternatively, some of the above-describedelements may be omitted from the programming module. Alternatively, theprogramming module may further include additional elements. Theoperations performed by the programming module or other elementsaccording to an embodiment of the present disclosure may be processed ina sequential method, a parallel method, a repetitive method, or aheuristic method. In addition, some of the operations may be omitted, orother operations may be added to the operations.

FIG. 4 is a block diagram illustrating a configuration of an electronicdevice according to various embodiments of the present disclosure.

Referring to FIG. 4, the electronic device 400 according to anembodiment of the present disclosure may be configured with a cameramodule 401, a display 402, a camera controller 403, an image signalprocessor (ISP) 404, a display controller 405, a storage unit 406, andan AP 407.

The camera module 401 can photograph an object lit by a display.

The light output by the display reaches an object and the object can belit by the light output by the display. Namely, the camera module 401can photograph the object lit by the display.

The display 402 can output a screen for the electronic device.

The display controller 405 is electrically connected to the display 402and controls the display 402 to operate by using at least 2 differentlighting parameters.

The display controller 405 can adjust a brightness of the display 402 byadjusting an electric current amount or a gamma value of the display402.

The display 402 may operate sequentially with at least 2 differentlighting parameters.

A lighting parameter includes at least one of an illuminance and a colorof the display 402. The lighting parameter may be configured with afirst lighting parameter, a second lighting parameter, and a thirdlighting parameter. However the lighting parameter is not limited to the3 lighting parameters and may be configured in a different way.

The color may include an RGB value of an image. The illuminance of thedisplay can be adjusted by controlling each RGB value of pixelsconfiguring an image. For example, if the RGB value of pixelsconfiguring an image is set to 255, a white image is displayed and theilluminance of the display reaches the maximum value. Further, if theRGB value of pixels is set to 0, a black image is displayed and theilluminance of the display reaches the minimum value.

When the display operates sequentially with 2 different lightingparameters, the lighting parameter may include information of an imageadditionally synthesized to obtained images. For example, the lightingparameter may include contents of synthesizing a white image obtained toincrease the brightness of the display.

When the display operates sequentially with 2 different lightingparameters, the lighting parameter may include a transparency ofobtained images. For example, the transparency can be applied partiallyto the obtained images by using an application in order to increase thebrightness of the display.

The display brightness corresponding to the second lighting parametermay be set greater than the display brightness corresponding to thefirst lighting parameter, and the display brightness corresponding tothe third lighting parameter may be set greater than the displaybrightness corresponding to the second lighting parameter. For example,the lighting parameters may be set such that the display brightnessgradually increases from the first lighting parameter to the thirdlighting parameter. In particular, the lighting parameter may output awhite image in order to obtain the maximum brightness of the display oran image corresponding to a predetermined brightness.

However the lighting parameters may not be set to adjust the brightnessby changing the electric current of the display. Rather than adjustingthe electric current to adjust the brightness of the display, thebrightness of the display can be adjusted by adjusting the RGB values ofa first image corresponding to the first lighting parameter to a finalimage corresponding to the final lighting parameter. This will bedescribed in more detail with reference to FIGS. 5, 6A, 6B, and 7.

The camera controller 403 is configured to control the camera module 401by using camera operation parameters.

The camera controller 403 is configured to determine a camera operationparameter corresponding to a final lighting parameter set while an imageis captured by the camera module 401. The operation of capturing animage may indicate capturing a final image.

The camera operation parameters may include, for example, at least oneof a camera exposure time, variables related to a camera auto exposure(for example, an aperture and a shutter speed), and color gains (autowhite balance (AWB)) for each pixel so that the camera module 401operates in relation of lighting output by the display corresponding tothe lighting parameter.

The camera operation parameters can be measured while the displayoperates according to the final lighting parameter, and a final cameraoperation parameter can be estimated by using a first camera operationparameter and a second camera operation parameter measured while thedisplay operates according to the first lighting parameter and thesecond lighting parameter, respectively. The period of measuring thecamera operation parameters can be determined according to theperformance of an electronic device such as the number of cores andoperating frequencies included in the AP 407. For example, in case of anelectronic device includes a number of cores in the AP 407 and a higherprocessing speed, the camera operation parameter can be obtained byusing a fast auto exposure (AE)/AWB algorithm while the display operatesaccording to the final lighting parameter. However, when an electronicdevice includes a relatively low processing speed, the camera operationparameter can be determined in a method that determines values of thefirst camera operation parameter and the second camera operationparameter in advance while the display operates according to the firstlighting parameter and the second lighting parameter, and a final cameraoperation parameter is estimated for a final image capture. For example,after measuring the first camera operation parameter and the secondcamera operation parameter, a specific function can be generated byusing the time or sequence of frames as an input value and the measuredcamera operation parameter as an output value. The final cameraoperation parameter can be determined on the basis of an output valuecalculated by inputting the time or sequence of frames into thegenerated specific function for a final image capture.

An ISP 404 is configured to process an image captured by the cameramodule 401. In more detail, the display brightness can be adjusted byadjusting an RGB value of an image and controlling to output theadjusted image to the display. For example, in case of outputting ablack image by setting the RGB value of a captured image to 0, thedisplay brightness may not be great even though an electric currentsupplied to the display is at the maximum level. Alternatively, in caseof outputting a white image by setting the RGB value of a captured imageto 255, the display brightness can reach the maximum level.

The ISP 404 according to an embodiment of the present disclosure canadjust the display brightness by processing an image output to thedisplay.

The storage unit 406 is configured to store a captured image.

The AP 407 is configured to execute an application. The AP 407 accordingto the present disclosure can process an application to apply a specificeffect to an image captured by the camera module 401. For example, theAP 407 can generate an image brighter than the existing image byapplying a transparency to the image captured by the camera module 401.Alternatively, the AP 407 can generate an image brighter than theexisting image by synthesizing a white image and the image captured bythe camera module 401.

Hereinafter, an electronic device for capturing an image by using adisplay according to an embodiment of the present disclosure isdescribed in more detail with reference to FIGS. 5, 6A, 6B, and 7.

FIG. 5 illustrates images captured while controlling to graduallyincrease the brightness of a display according to various embodiments ofthe present disclosure.

Referring to FIG. 5, the electronic device according to an embodiment ofthe present disclosure can capture a clear image from an object locatedin a dark place by using the illumination of the display. FIG. 5illustrates an image 510 output to the display 402 by capturing an imagewith the camera module 401 according to a capture command.

Here, the image 510 may be a first image collected by the camera moduleafter receiving an image capture signal.

Here, the image 510 may not show an object clearly in a display screenbecause the image 510 has been captured in a dark place.

Subsequently, the display 402 operates corresponding to a first lightingparameter, and the camera module 401 can generate the first image 520 byphotographing an object lit by the display operating corresponding tothe first lighting parameter and output the first image to the display402.

The method that the display 402 operates corresponding to the firstlighting parameter may be performed by outputting an image generated bychanging at least one of an illuminance and a color of the image 510 tothe display 402. In particular, the display 402 can operate so that anilluminance value included in the first lighting parameter can beoutput. Subsequently, if a predetermined time has elapsed after startingthe operation corresponding to the first lighting parameter, the display402 can start an operation corresponding to a second lighting parameter.If a predetermined time has elapsed after obtaining a first image, thedisplay 402 can start the operation corresponding to the second lightingparameter.

Here, the operation corresponding to the second lighting parameter canbe performed by outputting an image brighter than the first image 520 tothe display 402. The image brighter than the first image 520 can beobtained by adjusting an RGB value of the first image 520 based on thesecond lighting parameter. The image brighter than the first image 520can be output to the display 402 by processing with the ISP 404 or theAP 407.

Here, the camera module 401 can generate a second image 530 byphotographing an object lit by a display operating corresponding to thesecond lighting parameter and output the second image 530 to the display402.

Here, the first image 520 and the second image 530 may include outlinesof the objects, and the ISP 404 or the AP 407 can set the first lightingparameter and the second lighting parameter so that the object includedin the second image 530 is dimmer than the object included in the firstimage 520. In more detail, the RGB value increases as the first image510 switches to the second image 520 and an afterimage showing anoutline of an object may be generated and thereby the object can beshown by using the afterimage.

Subsequently, the display 402 starts an operation corresponding to afinal lighting parameter. The operation corresponding to the finallighting parameter can be performed by outputting an image brighter thanthe second image 530 to the display 402. The image brighter than thesecond image can be obtained by adjusting an RGB value of the secondimage 530 based on the final lighting parameter. The image brighter thanthe second image can be output to the display 402 by processing with theISP 404 or the AP 407.

Here, the final lighting parameter may correspond to a state that thebrightness output by the display 402 reaches the maximum value or astate that the brightness output by the display 402 is a predeterminedvalue. In FIG. 5, the final lighting parameter is assumed to be themaximum intensity of brightness output by the display 402. Accordingly,the display 402 outputs a white image like the image 540. The display402 can display white images 550, 560 continuously.

Subsequently, at least one camera operation parameter is obtained whilethe display 402 operates with the final lighting parameter, and theelectronic device according to an embodiment of the present disclosurecan photograph an object lit by the display 402 operating with the finallighting parameter and generate a final image 570 by using the cameramodule 401 and the camera operation parameters.

After final image 570 is generated, the display 402 can display an image580 which is same as the first image 510.

The final camera operation parameter can be determined also by a modulecontrol processor. For example, the module control processor candetermine a camera operation parameter corresponding to the finallighting parameter of the display 402 which is set as a lightingparameter while a capturing operation is performed by the camera module401. The capturing operation may mean an operation of capturing theimage 570.

Differently from the above method, before the display 402 operates withthe final lighting parameter, a camera operation parameter correspondingto the final lighting parameter can be obtained by using a first cameraoperation parameter obtained while capturing a first image and a secondcamera operation parameter obtained while capturing a second image.

Although a method for adjusting the brightness by using the ISP 404 orthe AP 407 has been illustrated in FIG. 5, a color can be adjusted byusing the ISP 404 or the AP 407 and camera operation parameters forphotographing with a proper color temperature can be obtained in asimilar method.

Here, the characteristics of the display can be adjusted by using atleast one of a camera operation parameter, an ISP, an application forgiving a specific effect to an image, and a display controller.

In case of photographing a bright object by using an exposure time andgain values included in camera operation parameter, the brightness ofthe display can be increased while outputting a captured image to thedisplay.

Further, the brightness of the display can be increased by adjusting thebrightness of an image with an ISP while outputting the image to thedisplay.

Further, the brightness of the display can be increased with a method ofediting an image to brighten the image by using an application of givinga specific effect to the image and outputting the edited image to thedisplay.

Further, the brightness of the display can be increased by using adisplay controller and variables for controlling the display.

FIG. 6A illustrates a method for adjusting a display based on a firstlighting parameter to a third lighting parameter according to anembodiment of the present disclosure.

Referring to FIG. 6A, an image captured by a camera module 401 isobtained at operation 610 and the image is pre-processed by an ISP 404at operation 620.

Here, the camera operation parameters can be monitored by using theresult obtained from the ISP 404 pre-processing the image at operation621.

Further, a compensation for an image brightness is performed based onthe image processed by the ISP 404 at operation 630, and the brightnessof the display 402 is increased by outputting the image compensated withthe brightness to the display 402 at operation 640.

Here, the brightness of the display 402 can be controlled by using anapplication and the AP 407 can perform a compensation for the imagebrightness at operation 641.

FIG. 6B illustrates an example of photographing an object by using adisplay of an electronic device which performs an image captureaccording to an embodiment of the present disclosure.

Referring to FIG. 6B, the camera module 401 of the camera modulephotographs an object 660 by using the light emitted by the display 402.

The display 402 operates according to at least 2 different lightingparameters in order to generate an afterimage effect for an objectincluded in an image. The camera module 401 included in the cameramodule can photograph the object 660 by using the light emitted by thedisplay 402.

The object 660 can be located in an intersecting area between an area650 where the camera of the camera module can capture an image and anilluminating area 680 where the light is emitted by the display 402.

It may not be necessary to locate the object 660 in the area 670. Forexample, FIG. 6B illustrates that the object 660 is located in the area670 to obtain an optimum photographing effect.

FIG. 7 is a graph illustrating changes of an image brightness and anelectric current amount supplied to a display according to an embodimentof the present disclosure.

Referring to FIG. 7, the graph of FIG. 7 is configured with a time axis,brightness axis, and electric current amount axis, and shows brightness(710, 721, 731, 741, and 751) and electric current amounts (711, 722,732, 742, and 752) of the display with respect to time (700, 710, 720,730, 740, 750, and 760).

First, the electric current amount to be supplied to the display isdescribed.

With reference to FIG. 7, the electric current may not be supplied tothe display or a small amount of the electric current may be supplied tothe display from receiving a capture command at time 700 to time 710.

After time 710, the supply of electric current to the display increasesafter a specific time has elapsed. However, the amount of electriccurrent supplied to the display reaches a certain value. As shown inFIG. 7, the amount of electric current supplied to the display increasesfrom time 710 to time 740, maintains a certain value from time 740 totime 750, and drops to 0 after capturing an image (i.e., at time 760).

As the electric current supplied to the display increases, the maximumbrightness of the display increases. Namely, in the electronic deviceaccording to an embodiment of the present disclosure, the brightness ofthe display is fixed to a maximum value because the amount of electriccurrent supplied to the display becomes steady from time 740 to time750. Of course, the amount of electric current supplied to the displaymay become steady because the amount of electric current is maintainedin a predetermined deviation range.

The display brightness is described by reference to FIG. 7.

With reference to FIG. 7, the display brightness increases graduallyfrom time 710 to time 740.

As shown by reference number 721, the display brightness correspondingto the first lighting parameter increases to be higher than that of time710.

As shown by reference number 731, the display brightness correspondingto the second lighting parameter increases further to be higher thanthat of time 720.

As shown by reference number 741, the display brightness correspondingto the final lighting parameter reaches the maximum value.

Subsequently, the electronic device according to an embodiment of thepresent disclosure maintains the reference brightness 741 after aspecific time 740 and captures an image at a specific time 750.

After capturing the image, the display brightness is decreased to thelevel of the capture command at time 700.

FIGS. 8, 9, and 10 are graphs illustrating various examples ofincreasing brightness of a display according to various embodiments ofthe present disclosure.

Referring to FIG. 8, the display brightness can be increased by using asynthesized step function.

Referring to FIG. 9, the display brightness can be increased by using alinear function.

Referring to FIG. 10, the display brightness can be increased by using anon-linear function.

Namely, a display parameter including a display brightness can beincreased linearly or non-linearly. Here, the display brightness can beadjusted by adjusting an RGB value of an image as described above.

FIGS. 11 and 12 are graphs illustrating examples of obtaining cameraoperation parameters for each frame according to various embodiments ofthe present disclosure.

Referring to FIG. 11, the frame corresponds to an image obtained at adifferent time such as a first image and a second image.

The electronic device capturing an image by using a display according toan embodiment of the present disclosure by analyzing each frame todetermine camera operation parameters.

The camera operation parameters may correspond to parameters foroperating a camera by using a histogram analysis and an AE/AWB algorithmfor determining a brightness of an image and a color temperature.

FIGS. 11 and 12 illustrate that the camera operation parameters changelinearly as the display brightness changes linearly. Accordingly, ifcamera operation parameters corresponding to a first lighting parameterand camera operation parameters corresponding to a second lightingparameter are extracted, camera operation parameters corresponding to afinal lighting parameter can be estimated based on the camera operationparameters corresponding to the first lighting parameter and the cameraoperation parameter corresponding to the second lighting parameter.

Further, the camera operation parameters can be obtained after thedisplay brightness is increased to the maximum value without analyzingeach frame. The timing of obtaining camera operation parameters can bedifferent based on the performance of the electronic device such as thenumber of cores included in an AP and operating frequencies. Forexample, in case of an electronic device having a number of cores in theAP 407 and a higher processing speed, the camera operation parameter canbe obtained by using a fast AE/AWB algorithm while the display operatesaccording to the final lighting parameter. However, in case of anelectronic device having a relatively low processing speed, the cameraoperation parameter can be determined in a method that determines valuesof the first camera operation parameter and the second camera operationparameter in advance while the display operates according to the firstlighting parameter and the second lighting parameter, and a final cameraoperation parameter is estimated for a final image capture. For example,after measuring the first camera operation parameter and the secondcamera operation parameter, a specific function can be generated byusing the time or sequence of frames as an input value and the measuredcamera operation parameter as an output value. The final cameraoperation parameter can be determined on the basis of an output valuecalculated by inputting the time or sequence of frames into thegenerated specific function for a final image capture.

FIG. 13 is a flowchart illustrating a method for capturing an image byusing a display according to an embodiment of the present disclosure.

Referring to FIG. 13, the display initially operates with a firstlighting parameter at operation 1310.

The first lighting parameter corresponds to a setting related to atleast one of the brightness and color of the display.

In order to operate the display with the first lighting parameter, animage can be edited so that the brightness and color of the imagecaptured from an object lit by the display corresponds to the firstlighting parameter and the edited image can be output to the display.

Subsequently, a first image is captured from an object lit by thedisplay operating with the first lighting parameter at operation 1320.

Subsequently, the display operates with a second lighting parameter atoperation 1330.

The second lighting parameter corresponds to a setting related to atleast one of the brightness and color of the display.

As a method for operating the display with the second lightingparameter, the brightness and color of the first image can be edited andthe edited image can be output to the display.

The second lighting parameter can be set such that the displaybrightness corresponding to the second lighting parameter is greaterthan the display brightness corresponding to the first lightingparameter.

The second lighting parameter can be set such that the colorcorresponding to the second lighting parameter is brighter than thecolor corresponding to first second lighting parameter. Namely, theilluminance of the display operating with the second lighting parametercan be greater than the illuminance of the display operating with thefirst lighting parameter.

The ISP or the AP can edit the first image.

As described above, the ISP can edit the first image to a brighter imageby adjusting an RGB value of an input image, and the AP can edit thefirst image by applying a transparency effect to the first image andsynthesizing the first image with a white image.

Subsequently, a second image is obtained by capturing an object lit bythe display operating corresponding to the second lighting parameter atoperation 1340.

The object is included in the first image and the second image, and theoutline of the object included in the second image may be dimmer thanthe outline of the object included in the first image because the secondimage is edited to be brighter than the first image. Accordingly, anobject can be easily composed because the outline of the object can beoutput in an afterimage form while preparing an image capture.

Subsequently, camera operation parameters are obtained while the displayoperates with a final lighting parameter at operation 1350.

The final lighting parameter may correspond to a condition that thedisplay outputs the maximum brightness or a predetermined brightness.Namely, the image output to the display corresponding to the finallighting parameter can be a white image or an image including a portionof an object.

The final lighting parameter may provide a display brightness higherthan the display brightness corresponding to the first lightingparameter and the second lighting parameter.

In the meantime, the method for operating the display with the finallighting parameter can be performed by editing the brightness and colorof the second image and outputting the edited image.

Finally, an object is captured by using the display operating with theobtained camera operation parameters and the final lighting parameter atoperation 1360.

In accordance with FIG. 13, the camera operation parameter is obtainedafter the display operates with the final lighting parameter. However,the time for obtaining the camera operation parameter is not limited inthe present disclosure. This will be described in more detail withreference to FIG. 14.

FIG. 14 is a flowchart illustrating a method for capturing an image byusing a display according to an embodiment of the present disclosure.

Referring to FIG. 14, the display operates with a first lightingparameter at operation 1410.

Subsequently, a first camera operation parameter is obtained while thedisplay is operating with the first lighting parameter at operation1420.

The first camera operation parameter can be obtained by analyzing animage captured by the camera module.

Subsequently, the display operates with a second lighting parameter atoperation 1430, and a second camera operation parameter is obtainedwhile the display is operating with the second lighting parameter atoperation 1440.

Subsequently, a third camera operation parameter is obtained based onthe first camera operation parameter and the second camera operationparameter at operation 1450.

Subsequently, the display operates with a final lighting parameter atoperation 1460, and an object is captured by using the display operatingwith the third camera operation parameter and the final lightingparameter at operation 1460.

Referring back to FIGS. 11 and 12, the camera operation parameter maychange linearly as the display brightness changes linearly. Accordingly,the camera operation parameters corresponding to the final lightingparameter can be estimated by extracting the first camera operationparameter corresponding to the first lighting parameter and the secondcamera operation parameter corresponding to the second lightingparameter.

FIG. 15 is a flowchart illustrating a method for capturing an image byusing a display according to an embodiment of the present disclosure.

Referring to FIG. 15, the camera operation parameters can be determinedwhile the display is operating corresponding to the final lightingparameter. By contrast, as discussed above with reference to FIG. 14,the camera operation parameters are estimated before the displayoperates corresponding to the final lighting parameter.

Initially, at operation 1510, an object is lit sequentially by using aplurality of different lighting parameters corresponding to imagecaptures.

Images are captured sequentially by using a plurality of differentcamera operation parameters at operation 1520.

A final camera operation parameter for capturing an image is determinedbased on the images captured in a lighting condition corresponding tothe lighting parameters at operation 1530.

The above-discussed method is described herein with reference toflowchart illustrations of user interfaces, methods, and computerprogram products according to embodiments of the present disclosure. Itwill be understood that each block of the flowchart illustrations, andcombinations of blocks in the flowchart illustrations, can beimplemented by computer program instructions. These computer programinstructions can be provided to a processor of a general purposecomputer, special purpose computer, or other programmable dataprocessing apparatus to produce a machine, such that the instructions,which are executed via the processor of the computer or otherprogrammable data processing apparatus, create means for implementingthe functions specified in the flowchart block or blocks. These computerprogram instructions may also be stored in a computer usable orcomputer-readable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner, such that the instructions stored in the computer usable orcomputer-readable memory produce an article of manufacture includinginstruction means that implement the function specified in the flowchartblock or blocks. The computer program instructions may also be loadedonto a computer or other programmable data processing apparatus to causea series of operations to be performed on the computer or otherprogrammable apparatus to produce a computer implemented process suchthat the instructions that are executed on the computer or otherprogrammable apparatus provide operations for implementing the functionsspecified in the flowchart block or blocks.

Each block of the flowchart illustrations may represent a module,segment, or portion of code, which comprises one or more executableinstructions for implementing the specified logical function(s). Itshould also be noted that in some alternative implementations, thefunctions noted in the blocks may occur out of the order. For example,two blocks shown in succession may in fact be executed substantiallyconcurrently or the blocks may sometimes be executed in the reverseorder, depending upon the functionality involved.

Certain aspects of the present disclosure can also be embodied ascomputer readable code on a non-transitory computer readable recordingmedium. A non-transitory computer readable recording medium is any datastorage device that can store data which can be thereafter read by acomputer system. Examples of the non-transitory computer readablerecording medium include a ROM, a RAM, compact disc-ROMs (CD-ROMs),magnetic tapes, floppy disks, and optical data storage devices. Thenon-transitory computer readable recording medium can also bedistributed over network coupled computer systems so that the computerreadable code is stored and executed in a distributed fashion. Inaddition, functional programs, code, and code segments for accomplishingthe present disclosure can be easily construed by programmers skilled inthe art to which the present disclosure pertains.

It is noted that the various embodiments of the present disclosure asdescribed above typically involve the processing of input data and thegeneration of output data. This input data processing and output datageneration may be implemented in hardware or software in combinationwith hardware. For example, specific electronic components may beemployed in a mobile device or similar or related circuitry forimplementing the functions associated with the various embodiments ofthe present disclosure as described above. Alternatively, one or moreprocessors operating in accordance with stored instructions mayimplement the functions associated with the various embodiments of thepresent disclosure as described above. If such is the case, it is withinthe scope of the present disclosure that such instructions may be storedon one or more non-transitory processor readable mediums. Examples ofthe processor readable mediums include a ROM, a RAM, CD-ROMs, magnetictapes, floppy disks, and optical data storage devices. The processorreadable mediums can also be distributed over network coupled computersystems so that the instructions are stored and executed in adistributed fashion. In addition, functional computer programs,instructions, and instruction segments for accomplishing the presentdisclosure can be easily construed by programmers skilled in the art towhich the present disclosure pertains.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. An electronic device for capturing an image byusing a display, the electronic device comprising: a display; a displaycontroller configured to operate the display using a first lightingparameter and a second lighting parameter to generate an afterimageeffect for objects included in images; a camera configured to capture animage to be displayed by the display; and a processor configured to:control the camera to obtain a first image while the display operatesusing the first lighting parameter, determine the second lightingparameter to display an image with increased brightness of the firstimage, control the camera to obtain a second image while the displayoperates using the second lighting parameter, determine a final lightingparameter to display an image with increased brightness of the secondimage, determine a camera operation parameter while the display operatesusing the final lighting parameter, and control the camera to obtain afinal image based on the determined camera operation parameter while thedisplay operates using the final lighting parameter.
 2. The electronicdevice of claim 1, wherein the final lighting parameter corresponds toat least one of an illuminance and a color.
 3. The electronic device ofclaim 1, wherein the final lighting parameter corresponds to the maximumilluminance of the display.
 4. The electronic device of claim 1, whereinthe final lighting parameter corresponds to a predetermined illuminanceof the display.
 5. The electronic device of claim 1, wherein anilluminance of the second lighting parameter is greater than anilluminance of the first lighting parameter.
 6. The electronic device ofclaim 1, wherein the processor is further configured to: obtain thefirst image by outputting an image generated by converting a red, green,and blue (RGB) value corresponding to an input image based on the firstlighting parameter, and obtain the second image by outputting an imagegenerated by converting an RGB value corresponding to the first image tothe display based on the second lighting parameter.
 7. The electronicdevice of claim 1, wherein the processor is further configured tocontrol the display to generate an afterimage effect for an outline ofan object included in the first image and the second image by operatingthe display sequentially with at least two different lighting parametersand outputting the first image and the second image to the display in apredetermined time interval.
 8. The electronic device of claim 1,wherein the camera operation parameter comprises at least one of anexposure time, a color compensating parameter, a gain value of a sensor,and a white balance of the camera.
 9. The electronic device of claim 1,wherein the processor is further configured to: estimate a final cameraoperation parameter corresponding to the final lighting parameter basedon a function generated by using a first camera operation parametercorresponding to the first lighting parameter and a second cameraoperation parameter corresponding to the second lighting parameter, andobtain the final camera operation parameter according to a result of theestimate.
 10. The electronic device of claim 8, wherein the processor isfurther configured to obtain the camera operation parametercorresponding to the final lighting parameter while the display operatescorresponding to the final lighting parameter.
 11. The electronic deviceof claim 8, wherein the processor is further configured to control thecamera to photograph an object after the display maintains a brightnesscorresponding to the final lighting parameter for a predetermined time.12. The electronic device of claim 1, wherein the display controller isfurther configured to supply a predetermined amount of electric currentto the display.
 13. The electronic device of claim 1, wherein theprocessor is further configured to: control the camera to obtain a firstimage and a second image while the display sequentially operates basedon the first lighting parameter and the second lighting parameter,determine the camera operation parameter of the camera after obtainingthe first image and the second image, and obtain a final image based onthe final lighting parameter of the display.
 14. A method for capturingan image by using a display of an electronic device, the methodcomprising: capturing, by a camera, a first image while the displayoperates using a first lighting parameter; determining, by a processor,a second lighting parameter to display an image with increasedbrightness of the first image; capturing, by the camera, a second imagewhile the display operates using the second lighting parameter;determining, by the processor, a final lighting parameter to display animage with increased brightness of the second image; determining acamera operation parameter while the display is operating using thefinal lighting parameter; and capturing a final image based on thedetermined camera operation parameter while the display is operatingusing the final lighting parameter.
 15. The method of claim 14, whereinthe final lighting parameter corresponds to at least one of anilluminance and a color.
 16. The method of claim 15, wherein anilluminance of the second lighting parameter is greater than anilluminance of the first lighting parameter.
 17. The method of claim 15,further comprising: controlling the display to generate lighting byoutputting an image generated by converting a red, green, and blue (RGB)value corresponding to an input image based on the first lightingparameter; capturing the first image by using the generated lighting;controlling the display to generate lighting by outputting an imagegenerated by converting an RGB value corresponding to the first image tothe display based on the second lighting parameter; and capturing thesecond image by using the generated lighting.
 18. The method of claim15, further comprising: controlling the display to operate sequentiallybased on the first lighting parameter and the second lighting parameter;and outputting a first image and a second image captured by the camerain a predetermined time interval to generate an afterimage effect for anoutline of an object included in the first image and the second image.